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NOMENCLATURE 


C controller gain (response feedback) 

controller gain, due to control-rate limit 

A 0 

Cq controller gain, due to control-magnitude limit 
f factor defining functional dependence of r, P, and Q on j 
J quadratic performance function 

Kalman-filter or recursive algorithm gain 
L number of parameters identified 

M a priori error variance matrix 

m a priori error variance 

N number of measurements 

P error variance matrix 

p error variance 

Q parameter variance matrix 

q parameter variance 

R measurement noise variance matrix 

r measurement noise variance 

T transfer-function matrix 

t transpose of row of T matrix; time 
u random variable describing parameter variation 
V measurement noise 

W weighting matrix 

W2 weighting matrix in performance function, on response 

W weighting matrix in performance function, on control rate 

A 0 

W weighting matrix in performance function, on control amplitude 
6 

W2 weight in performance function 

Z matrix of response-vector measurements 


V 


z vector of harmonics of response variables 

Zq uncontrolled response level 

a exponential filter parameter 

At sampling time-step 

Az response increment, z - z 

n n-i 

A9 control increment, 0-9 
“ n n-i 

‘^nm Kronecker delta function (6 = 1 if n = m; zero otherwise) 
0 matrix of control-vector measurements 
0 vector of harmonics of control variables 
0Q input 9 required for zero response 
X eigenvalue 

Ac empirical factor in cautious controller 

T time constant 

Subscripts: 

j measurement number 
n,m time-step 
0 initial conditions 
Superscript : 

T transpose 
Special characters: 

E( ) expectation 
( ) estimate 

( ) a priori estimate (before measurement) 
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SELF-TUNING REGULATORS FOR MULTICYCLIC CONTROL 


OF HELICOPTER VIBRATION 
Wayne Johnson 
Ames Research Center 


SUMMARY 


A class of algorithms for the multicyclic control of helicopter vibration and 
loads is derived and discussed. This class is characterized by a linear, quasi— static , 
frequency— domain model of the helicopter response to control; identification of the 
helicopter model by least— squared— error or Kalman— filter methods; and a minimum 
variance or quadratic performance function controller. Previous research on such con- 
trollers is reviewed and related to the present work. The derivations and discussions 
cover the helicopter model; the identification problem, including both off-line and 
on-line (recursive) algorithms; the control problem, including both open-loop and 
closed-loop feedback; and the various regulator configurations possible within the 
class. Conclusions from analysis and numerical simulations of the regulators provide 
guidance in the design and selection of algorithms for further development, including 
wind-tunnel and flight tests. 


INTRODUCTION 


A class of algorithms for the multicyclic control of helicopter vibration and 
loads, currently being developed by several investigators, is characterized by (1) a 
linear, quasi— static , frequency-domain model of the helicopter response to control; 

(2) identification of the helicopter model by least-squared error or Kalman-f liter 
methods; and (3) a minimum variance or quadratic performance function controller. 

Such a control system combining recursive parameter estimation with linear feedback 
is called a self-tuning regulator. 

Figure 1 outlines the control task. It is desired to minimize airframe vibra- 
tion, the loads on the rotating and nonrotating components, and possibly the power 
requirement of the helicopter. The control parameters available are normally the 
pitch angles of the rotor blades, which are positioned by actuators in the rotating 
or nonrotating frame. In steady-state flight, the helicopter vibratory motion is 
ideally periodic, with fundamental frequency Q for components in the rotating frame 
and N^^ for components in the nonrotating frame (where Q is the rotational speed of 
the rotor, and N is the number of blades; see Johnson (1980)). Hence the control 
required to alleviate the vibration and loads will be periodic, and the control system 
can deal with the harmonics of the input and output. 

This control is referred to as multicyclic or higher-harmonic control, to dis- 
tinguish it from the mean and once-per-revolution blade-pitch control (in the rotating 
frame) that is required to trim the helicopter. The regulator algorithm consists of 
parameter estimation, gain calculation, and the control feedback. Some of these steps 
may be performed off-line. A digital control system operating on the harmonics of the 
input and output is considered here. Hence, the regulator also includes transforma- 
tions between the time and frequency domains, and between analog and digital 


representations of the signals. The present report is concerned with the regulator 
algorithms, so the time-frequency domain and analog-digital transformations are not 
considered further. Moreover, the actuators can be treated by simply including them 
in the helicopter model. Hence the simplified system outline in figure 2 is the basis 
for the present work. Only self-tuning regulators and related systems are examined in 
this report. Shaw (1980), McCloud (1980a, b), and Johnson (1980) review multicyclic 
control, including other feedback concepts, and discuss helicopter vibration in 
general. 


OPERATING 

CONDITIONS 



Figure 1.- Schematic of helicopter Figure 2.- Simplified schematic for a 

multicyclic control system. digital frequency-domain control system. 


Previous Work 

McCloud and Kretz (1974) and Kretz et al. (1973a, b) tested multicyclic control 
on a full-scale jet-flap rotor in a wing tunnel. They examined the response of the 
blade loads and vibration to control in the rotating frame. They introduced the con- 
cept of a linear, quasi-static representation of the rotor response (including the 
notation "T" for the transfer function). This transfer function representation was 
attributed to J.-N. Aubrun (McCloud and Kretz, 1974). The T-matrix was calculated 
from the wind-tunnel data by the least-squares method. Then the open-loop control 
required to minimize a quadratic performance function was calculated. McCloud (1975) 
applied this method to data obtained by theoretical analysis of a Multicyclic Con- 
trollable Twist Rotor (MCTR) . He considered the reduction of both blade loads and 
hub shears, including the influence of the relative weights on the loads and 
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vibration in the performance function. McCloud and Weisbrich (1978) then applied the 
method to data from a wind-tunnel test of a full-scale MCTR. They considered the 
control required to reduce both blade loads and test module acceleration, including 
the influence of relative weights in the performance index and the sensitivity of the 
control to the rotor lift. Brown and McCloud (1980) considered reduction of the test 
module vibration, using the data from the MCTR test again. They examined the influ- 
ence of the relative weights on the various accelerometers, and the influence of 
weights on the control magnitude in the performance function. They examined the 
influence of rotor lift, propulsive force, and speed on the open-loop control. 

Sissingh and Donham (1974) tested a model hingeless rotor in a wind tunnel. They 
measured the vibratory hub moment and vertical shear response to swashplate control. 
The transfer-function matrix and the control required to eliminate the vibration were 
then calculated by direct inversion. Powers (1978) and Wood et al. (1980) tested a 
model articulated rotor in a wind tunnel, measuring the response of the oscillatory 
shaft forces to swashplate control. They calculated the transfer-function matrix by 
several methods. The control required to null the hub forces was calculated by direct 
inversion of the T-matrix. McHugh and Shaw (1978) tested a model hingeless rotor in 
a wind tunnel, measuring the vibratory hub moments and vertical shear response to 
swashplate control. They also considered blade loads. The input required to null the 
hub moment was estimated by extrapolation and interpolation of the test data. The 
resulting control did not null two or three quantities at the same time, but it did 
reduce all three hub loads when tested in the wind tunnel. 

Shaw and Albion (1980) also measured the response to swashplate control of a 
model hingeless rotor in a wind tunnel. They considered third, fourth, and fifth 
harmonics of the root flapwise bending, which were equivalent to the vibratory hub 
moments and vertical shear for this four-bladed rotor. They tested closed-loop feed- 
back control of the loads, with the control gains obtained by direct inversion of the 
T-raatrix. This controller was able to null the vibratory loads at one speed; the 
loads were reduced at higher and lower speeds, but not nulled because the pitch 
required exceeded the available control authority. The transient characteristics of 
the controller were good. 

Shaw (1980) conducted a theoretical investigation of the closed-loop feedback 
control of vibratory vertical and in-plane hub shears. The control gains were again 
calculated by direct inversion of the T-matrix, and he considered the influence of 
errors in the estimate of the T-matrix on the stability of the controller. The sys- 
tem response was calculated for an abrupt maneuver (a change in speed, hence a change 
in the level of vibration and the true T-matrix), using a fixed-gain matrix. The 
controller performance was good when a single input was used to reduce the vertical 
shear, but was poor when two input parameters (two harmonics) were used to reduce 
both vertical and in-plane shear forces. The poor performance in the latter case was 
caused by the T-matrix changing enough to make the controller unstable. Hence a 
fixed-gain matrix was not acceptable; gain scheduling or on-line identification would 
be necessary to estimate the parameters accurately enough for satisfactory closed-loop 
performance. Shaw used a Kalman filter for on-line identification of the T-matrix. 
When applied to the case involving reduction of both vertical and in-plane shears , the 
control system utilizing the Kalman filter displayed good convergence and stability, 
confirming its ability to handle abrupt changes in parameters. 

Taylor, Farrar, and Miao (1980) and Taylor et al. (1980) conducted a numerical 
simulation of the control of helicopter fuselage acceleration, using closed-loop 
feedback control and a Kalman filter for on-line identification of the T-matrix. 

The feedback gains were calculated to minimize a quadratic performance function. This 
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control concept was developed by J. A. Molusls. The simulations were for a constant 
flight condition, and the performance of the system was studied in terms of the ini- 
tial behavior after starting the regulator. The control system showed good conver- 
gence and accomplished a significant reduction in the vibration. The above authors 
examined the influence of the relative weights on the accelerometers in the perfor- 
mance function, on the update time, on the measurement noise level, and the influence 
of a limit on the maximum control change in one step. 

Hammond (1980) tested a model articulated rotor in a wind tunnel. The response 
of vibratory hub moments and vertical shear to swashplate control was measured. A 
Kalman filter was used to identify the T-matrix and the uncontrolled vibration level. 
Feedback of the identified vibration level was used to minimize a quadratic perfor- 
mance function. Both deterministic and stochastic (or cautious) control algorithms 
were considered, as well as an option to identify only the vibration level, not the 
T-matrix. The development of these regulator algorithms was attributed to J. A. 
Molusis (Hammond, 1980). Test results were presented only for the cautious con- 
troller. A converged solution was reached when the controller was started with 
specified initial estimates. The controller reduced the vertical force significantly, 
3^nd reduced the pitch moment to some extent j however, the roll— moment reduction was 
small. Molusls, Hammond, and Cline (1981) extended this investigation, considering 
feedback of vertical, longitudinal, and lateral acceleration. The controllers were 
tested in steady-state operating conditions, with varying wind-tunnel speed, and with 
collective pitch variations. The cautious controller showed good performance, with 
smooth operation and good tracking ability. The vertical and longitudinal vibrations 
were reduced significantly, but the lateral acceleration was actually increased at 
low speed. The deterministic controller was more erratic than the cautious control- 
ler, and the system using identification of only the uncontrolled acceleration level 
was not successful in reducing the vibration* 

The research outlined above has established that multicyclic control can reduce, 
and in many cases null, helicopter vibration and loads. That most of this work has 
been based on experimental data reflects the difficulty of calculating vibration and 
simulating the system dynamics using current analytical tools. The theoretical 
investigations have been useful, however, and consistent with the experiments. As 
yet there have been no flight tests of such regulators; all of the tests have been 
conducted in wind tunnels. Moreover, the experimental verification of these control 
concepts has either been only partially successful, or has not yet been accomplished. 
The work discussed above can all be considered to deal with the same type of regu- 
lator, and most of the possible combinations of control and identification algorithms 
within this class of regulators have been examined to some extent. However, with the 
exception of the work of Shaw (1980) and of Molusis, Hammond, and Cline (1981), there 
has been little derivation or discussion of the regulator algorithms, and little 
direct comparison of the alternatives. 


Scope of Present Investigation 

The present paper provides a detailed derivation and discussion of the class of 
control algorithms characterized by a self-tuning regulator applied to a quasi-static 
model of the helicopter response. This work is intended to guide the selection of 
algorithms for further development, including wind-tunnel and flight tests. The 
paper discusses the helicopter model; the identification problems, including off-line 
and on-line algorithms; the control problem, including open-loop and closed-loop 
feedback; and the various regulator configurations possible within this class of 
control systems. The behavior and characteristics of these regulators are examined. 
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particularly by analysis and numerical simulations of a single-input and single output 
system. The conclusions about the design of the regulators are summarized, and 
recommendations for further work are given. 


HELICOPTER MODEL 


It is assumed that the helicopter can be represented by a linear, quasi static 
frequency-domain model relating the output z to the input 0 (see fig. 2) at time 
tj^ = n At. Here z is a vector of the harmonics (both sine and cosine components) of 
the loads and vibration, in either the rotating or the nonrotating frame. Performance 
quantities, such as the mean power, can also be included in z. The input 6 is a 
vector of the harmonics of the multicyclic control, in either the rotating or non- 
rotating frame. The sampling time-step At must be long enough for transients to die 
out and for the harmonics to be measured. Typically, this requires an interval of at 
least one rotor revolution. The operating condition is defined by the rotor lift, 
propulsive force, and forward speed (at least). It is possible to investigate the 
relationship of the vibration and loads to these operating condition parameters, in 
the same manner that the relationship to the control parameters is established (see 
McCloud and Kretz, 1974). For the present purpose it is only necessary to recognize 
that the helicopter model will depend on the operating condition. 

Local and global models of the helicopter response are considered. The local 
model is a linearization of the response about the current control value; 


(a) 


z 

n 


z 


n-i 


+ T(0 

n 


6 


n-i 


) 


or Az^ = global model is linear over the entire range of control: 


(b) 


Zfl + T0 
0 n 


Note that the global model also gives Az^^ - TA0^^; the global model implies that T 
is independent of and - T0^_^. Here z^ is the uncontrolled vibra- 

tion level, and in both models T is the transfer-function matrix. Three cases are 
distinguished for the global model, depending on the identification algorithm: 

(bl) identify Zq only 

(b2 ) identify T only 

(b3) identify both Zq and T 

If only T or only Zq is identified, the remaining parameters must be estimated by 
some other means (e.g., direct measurement, off-line identification, or calculation). 
It is possible to measure Zq directly by setting 0=0. 

The quasi-static assumption requires that the update time At be long enough 
for transients produced in the response harmonics by the control change to die out. 

A linear, dynamic system could be described by an equation of the following form: 


z^ = > F^ z ^ , G , 0 , 

n in n-i in n-i 

i=i i=o 
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where and matrices that describe the system. Here the variables z and 

0 3te obtained from the data in the time— domain by a linear operator (an analog or 
digital filter that is equivalent to harmonic analysis for steady-state data) . The 
coefficient matrices are in general a function of n since the helicopter in forward 
flight is not a time— invariant system; rather it is described by periodic coefficient 
differential equations. To keep the identification problem manageable, it would be 
desirable to maintain the time-step At large enough so that the dependence of the 
coefficient matrices on n could be neglected, and so that the summation over i 
could be truncated at one or two steps. Such a model for the helicopter dynamics is 
not considered further in the present report. 

The assumption of linear response to control is expected to be reasonable, since 
the available experimental data imply that only a small multicyclic control amplitude 
(of the order of 0.5° to 1.5°) is required for vibration alleviation. The uncon- 
trolled vibration level (zq) is indeed a highly nonlinear function of the helicopter 
operating condition, and Involves nonlinear aerodynamic and dynamic phenomena. Here 
it is only the response to control inputs that is being linearized. There is some 
evidence of nonlinear response to control over the required amplitude range, which 
may require the use of the locally linearized model defined above. McCloud (1975), 
in a theoretical investigation, and McCloud and Weisbrlch (1978), using experimental 
data, found it necessary to limit the calculation of the T-matrix to low-vibration 
data in order to improve the accuracy of the identified linear model, which had a 
significant influence on the predicted open— loop control. The experimental results of 
McHugh and Shaw (1978) show some nonlinear dependence of the response on the magnitude 
of the control. A similar effect was observed in the theoretical investigation of 
Taylor et al. (1980). However, Shaw (1980) concluded (based on theoretical calcula- 
tions) that the response was essentially linear, and Shaw and Albion (1980) concluded 
that their experimental results confirmed this linearity. 

The large variation of the uncontrolled vibration level with speed is well 
established (see Johnson, 1980). McCloud and Weisbrlch (1978) found a low sensitivity 
of the open-loop control to lift variations, by examining the calculated load allevia- 
tion over a range of lifts, using the open-loop control designed for a fixed-lift 
value in the middle of the range. Brown and McCloud (1980) found a weak influence of 
rotor lift and propulsive force on the calculated open-loop control, but a strong 
influence of flight speed on the T-matrix and the control. Shaw and Albion (1980) 
and Shaw (1980) found also that the T-matrix varied significantly with speed. The 
variation was large enough to make a closed-loop control system using constant gains 
unstable. Molusis, Hammond, and Cline (1981) found large differences in the 
T-matrices measured at three speeds. 


IDENTIFICATION 


In this section, algorithms for on-line and off-line identification of the 
parameters in the helicopter model are derived. The four models defined in the last 
section are considered: 

(a) Local: Az^^ = T AO^^ 

(bl) Global, identify Zg: z^^ - T0^ = Zg 

(b2) Global, identify T: = TB^^ 



(b3) Global, identify T and z^: = [T Zp] 


A common notation will be used to represent all four cases: 


(Note that for case (b3) , it is necessary to interpret "T" in this equation as Zp 
and "0" as 1.) For the case when T (or at least the estimate of T) is time varying, 
the equation becomes 



“n 


= TnQn + 


'n 


including measurement noise v^. It is assumed that there is no noise in the measure 
ment of 0. The identification algorithms will be derived considering the jth 
measurement: 


where tj is the jth row of T. Note that zj and vj are scalars. Often the sub 
script 2 will be omitted, to simplify the notation. 


= ®n^n + 


"n 


The task is to identify t from measurements of z. The measurement noise has zero 
mean, and variance = r^, 6^^ for the Jth measurement. For the local model 

(Interpreting "zn" as Az^) this representation of the noise is not correct, since 
noise in a measurement of z^ would contribute to both AZj^ and Hence, for 

that case successive values of v„ are correlated, with nonzero elements just above 
and Just below the diagonal in E(VnVj„). This complication will be ignored. 

The helicopter model includes cosine and sine harmonics for both input and output 
variables. For example, with a single input and single output, the equation is 



+ ^n 


Then for a linear time-invariant system (such as a helicopter with three or more 
blades in hover) the transfer function relating z and 0 is defined by two param- 
eters, not four: 


r *-c *-s'i 



The equation for the helicopter response can then be rewritten in terms of the param- 
eter vector t^ = (tj, bg): 
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• «c„ ^ 

.-«sn 9cnJvJ 

However, such a representation complicates the recursive identification algorithms (by 
introducxng matrices in place of vectors and scalars), because two measurements pro- 
vide information about the same two parameters. Moreover, in forward flight, the 
helicopter is described by periodic coefficient differential equations, which implies 
that all four elements in this T-matrix will be different. Consequently the dis- 
tinction between the cosine and sine harmonics is not introduced here. 



Least-Squares Method 


Off-line identification can be done by the method of least squares (Mendel, 1973; 
Goodwin and Payne, 1977). Off-line identification implies constant parameters. Also, 
the local model is not appropriate since it associates successive measurements. A 
set of N measurements is made, using a prescribed schedule of independent control 
Inputs. The number of measurements N (the dimension of z j , defined below) must be 
greater than the number of parameters to be identified L (the dimension of t-)- 
Consider the sum of the squares of errors: ^ 


N 


' ■ - St.) - 9t.) 

where the vector Zj and matrix 0 are defined as 


z . = I z . 

J I jn 



0 = 


n 


The solution that minimizes S is the least— squares estimate: 

t^ = (0’^0)“^e'^Zj 


or 


2 2 


Putting the rows together again gives 


T = Z0(0^0)~^ 


where 


Z = 


[ • • • • 1 


Note that £ is a linear estimate, that is, a linear function of the data Z. 
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It is assumed that the measurement noise Vjj is stationary, with zero mean, and 
is uncorrelated at different times [E(vjjV^) = r 6nml • There is no noise in the 
measurement of 0. It follows then that the least-squares estimate is unbiased, 

E(tj) = t j , and the error-variance is 

P = E(t^ - tj)(tj - tj)'^ = r(e'^0)-^ 

An unbiased -e of r is 

r = (z. - 0t.)"^(z, - 0t.)/(N - L) 

J 3 2 2 

With this type of measurement noise, the least-squares estimate is equivalent to the 
unbiased minimum error-variance estimate, so it has the minimum error-variance of all 
linear, unbiased estimators. 


Generalized Least-Squares Method 

The generalized least-squares estimate (Mendel, 1973) is obtained by minimizing 
the weighted sum of squares: 

S = (z. - 0t.)^W(z. - 0t.) 
w " J 3 1 3 


The solution is 


t. = (0^W0) ^ 0 '^Wz. 

3 3 

The matrix W can be used to introduce weights based on the level of 0 or z, for 
example to emphasize the measurements at low vibration levels in order to improve the 
identification in the vicinity of the optimum response. 

If the measurement noise has zero mean and variance E(v^Vjjj) = R, then the 
generalized least— squares estimate with W = R ^ is equivalent to the unbiased mini- 
mum variance estimate. Hence, when the noise is not stationary or is correlated, the 
weighting matrix is chosen to emphasize the more precise data. Using W = R , the 
error variance is 

p = (0\"^0)“^ 

If, in addition, the noise has a normal probability distribution, then the minimum- 
variance estimate is equivalent to the maximum— likelihood estimate. 


Recursive Parameter Identification 

Recursive algorithms will be used for on-line identification from a sequence of 
measurements of the response to control. These algorithms can be used when the 
parameters are constant, or when they vary with time; either global or local models 
of the helicopter can be used. The algorithms are still derived for the jth 
measurements, but the subscripts j are omitted to simplify the notation. Since the 
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parameters may be time-varying now, the equation of the helicopter model is 


T 

z = 6 t + V 
n n n n 


Recursive Generalized Least Squares 

A recursive form of the generalized least-squares estimate can be used for 
on-line parameter identification (Mendel, 1973; Goodwin and Payne, 1977). The 
weighted sum of squares 


S 

w 


N 

E 

n=i 


(z 


n 


e'^t )^w 
n n n 


is to be minimized. The solution was given above. Here the weighting matrix is 
diagonal, and, furthermore, the notation w^ = 1/r^^ will be used (where r^^ can be 
interpreted as the noise variance). The error matrix is defined as 




The effect of adding one more measurement, is obtained by applying the matrix 

inversion formula to 


^N+i ®N+i''n+i®N+i^ 


The result is the recursive algorithm 


*^n+i *^n \+i^^n+i ®n+i^n^ 


where the gain vector is obtained from 


’'n+l - 


^n+1 ^n+i^n+i^’^n+i 


This is the estimate for the jth measurement. In general there will be a different 
weight r for each measurement, hence a different solution for P and k. Let us 
assume, however, that the time behavior of r^ is the same for all measurements, 
that is, that for the jth measurement is a product of a function of time (n) 

and a function of the measurement (j). It is assumed that the starting value for P 
has the same variation. Hence 


r . 
jn 


f .r 
J n 


P. 

2 


0 


f .P 

J 


0 


It follows that the solution for 


P has the same behavior: 


P. 

jn 


f .P 
J 


n 
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and that the solution for kn+i is independent of f j , that is, the same for all 
measurements. The equations given above can thus be solved for which is multi 

plied by fj to get the true variance. With the same for each measurement, 

the rows 



t^ + 
n 


(z 




n 



can be combined to form 


^n+i ^n ^^n+i \®n+i^\+l 


(where here z is the vector of all measurements). So the entire matrix T can be 
identified in a single step, with k^+i calculated only once. 

If rji = 1 (or any other constant), the recursive least-squares algorithm is 
obtained. The solution will be the same as that from the batch least-squares algo- 
rithm. The recursive implementation might be useful in order to track the estimates 
and error as the data are acquired. Eventually the old data dominate (k approaches 
zero), however, so the recursive least-squares algorithm is not appropriate with 
time-varying parameters. 


Exponential Window 

A recursive estimate applicable to the case of time-varying parameters can be 
obtained using an exponential window for the weighting function (Goodwin and Payne, 
1977). By setting r^ = a", where 0 < a < 1, the current data are emphasized. Since 
rjj^ is continuously decreasing, it is best to solve for the gain k^j+j^ in terms of 
P* = P„/a^: 


p* = a"MP* - + e^iOn+i^^ 


n+1 


n 


n n+i n-fi n 


n+l 


= P 


n+i^n+i 


This algorithm can be obtained directly by minimizing the sum: 


N+i 


= aS^ + (z 


N+i 




Kalman-Filter Identification 

A Kalman filter can be used for on-line identification of time-varying param- 
eters (Bryson and Ho, 1969; Sage and Melsa, 1971). The equation for the jth 
measurement is again 


where the measurement noise has zero mean, variance E(v^v^) - r^^ ^nm» Gaussian 

probability distribution. The variation of the parameters will be modeled as a 
random process: 
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t , . = t + u 
n+1 n n 


where Uj^ is a random variable with zero mean, variance E(u^u^) = 6^^^, and 

Gaussian probability distribution. This equation implies that it is known that t 
varies, and that the order of the change in one time-step can be estimated; but no 
information is available about the specific dynamics governing the variation of t. 
The minimum error-variance estimate of tr 


is then obtained from a Kalman filter: 


where 


£ = t + k (z - 0^t ) 

n n-i n n n n-i 


M = P +0 
n n-i ^n-i 


P = (M"^ + 6 0 /r ) 
n n n n n' 


-1 


= M - M 0 0^M /(r + 0^M 6 ) 

n nnnn n nnn 

= (I - k 0^)M (I - k 0 '^)'*’ + k k^r 
nnn nn nnn 


k = P 0 /r 
n nnn 


= M 0 /(r + 0 M 0 ) 

n n n nnn 


Here is the variance of the error in the estimate of t^ before the measurement, 

and Pj^ is the variance after the measurement. Note that P depends on the control 
input 0, but not on the measurement z; and no matrix inversion is required, because 
t^ is related to only one measured variable. The Kalman filter can be considered a 
time-variant dynamic system with state t: 


where 


t = (I - k 0 )t + k z 
n n n n-i n n 


= (I - k 0^)t + k 0^t + k V 

n n n-i nnn n n 


I-k0'^ = I- P0 0^/r 
n n nnnn 


P 

n n 


If there are no process dynamics (Q^ = 0) , the Kalman filter is equivalent to the 
generalized least-squares algorithm with = l/r^j (for minimum error-variance). 


The variances r^j, and Pg are different for the various measurements. It 

will be assumed that Q and r have the same time variation for all measurements, and 
that Q, r, and Pg are proportional to the same function f j : 





n 
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Then it follows that Pj^ = fjPn ^ 

measurements. With the same gains, the rows can be combined now to form 


T = T 
n n-i 


+ 


(z - T 0 )k 
n n-i n n 


(here is the vector of all the measurements). So the entire matrix T is iden- 
tified in a single step, with and calculated only once. The basis of this 

result is the assumption that the ratio of the parameter and measurement noise 
variances, Qj^/r^^, is the same for every measurement. There is no reason to expect 
this assumption to be true, although it may be consistent with the accuracy of the 
knowledge of Q and r. The great reduction in computation is the strongest argument 
of accepting the assumption. 


The Kalman-filter algorithm is completed by the specification of and r^. 

Shaw (1980) discusses the choice of these parameters in terms of the noise sources 
for the helicopter. Taylor et al. (1980) used Q/T - 0.001, and 


n+i 


= r (J . /J ) 
n n+i n 


with minimum and maximum limits on r^, and Tq/zq - 0.3. Here J is a quadratic 
performance function, so this equation keeps the noise— to— signal ratio approximately 
constant. The generalized least-squares algorithm is obtained for Q = 0. 


In summary, the Kalman-filter algorithms for the local and global helicopter 
models are as follows: 


(a) 

(bl) 

(b2) 

(b3) 


T=T +[z-z -T (6-0 )]k 

n n-i ^ n n-i n-i^ n n 

Zn = Zo + (z - T0 - Zq -jk 
^n ^n-i V n n '^n-i/ n 

/s T 

T=T +(z-z. - T 0„)k 
n n-i n 0 n-i n n 

Ft Zn 1 = Ft 2o 1 +( 2 : - Zq - T 0 

L n ®nj I n-i °n-ij \n °n-i n-i n/ n 


and **0” in the calculation of P^ and k^ becomes A0 for (a), 1 for (bl), 0 for 
(b2), and (0^1)^ for (b3). For the last case, in which only Zq is identified, the 
gain calculation is simplified since ”0" = 1 and all quantities are scalars. In 
this case, k^ is determined solely by and r^, independent of the control 
input 0 . 


Indent if iability 

Estimation of parameters with closed-loop control can introduce identif iability 
questions. The equation for recursive identification of T and Zq is 
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The on-line identification algorithm will be used with closed-loop control of the 
system. Hence, in the steady-state limit (if it exists), the control 0^^ will 
approach a constant, and so the Kalman gains will also be constant. Consider the 
dynamics of the above equation when 0, k, and kz are constants. The steady-state 
solution is 

T 

z =Zn+0t=z„+0t 
n y 0 

and the eigenvalues X are obtained from 



Note that X = 1 is an eigenvalue. For 



T 

each row of the matrix is proportional to (0 1), so the determinant is zero as 

required. The eigenvector is the solution of the equation 

Zjj + 0^t = 0 


Thus, there are undamped modes in the identified solution. The problem is that in 
the steady state (with 0 constant), the algorithm is trying to identify more than 
one parameter, using only one measurement. The eigenvector of this undamped mode has 
components such that + 0^t = 0, so it will not influence the identification and 

prediction of z. Since the objective is to minimize z, it may be expected that the 
steady-state controlled response will remain acceptable. An error in the estimate of 
t may adversely affect the stability of the system, however. 

If only Zq is identified, then the nximber of parameters equals the ntimber of 
measurements always. If only t is identified, there will again be an eigenvalue 
X = 1 (with corresponding eigenvector such that 0^t = 0) if there is more than one 
parameter in t, that is, if there is more than one control variable. In the heli- 
copter problem, the multicyclic control variables include both cosine and sine har- 
monics, so there will always be at least two elements in t. 

Difficulties must be expected in the identification with a closed-loop system, 
if the number of parameters to be identified is greater than the number of 
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measurements. Astrom et al. (1977) suggest two ways to handle this problem. The 
first approach is to eliminate or reduce the redundancy by constraining the values of 
some parameters. Constraining some elements of t is possible (the Kalman-f ilter 
algorithm need not be changed), or only Zq can be identified. The second approach 
is to ignore the problem, since the estimate of the parameters is an intermediate step 
and errors are acceptable if the closed-loop performance of the system is good. 

In the present problem, the identif lability is also improved if the parameters 
do vary with time. Then the varying control input provides the independent measure- 
ments needed to obtain information about all the parameters. Note also that when the 
number of measurements equals the number of controls (T a square matrix) , the heli- 
copter equation can be written as 

z = Zq + T0 = T(0 - 0q) 


It is desired to identify Oq in this case, so z = 0 can be achieved with closed- 
loop control. The matrix T must be known accurately enough for acceptable conver- 
gence and stability. In this case Identifying 0^ is equivalent to identifying Zg. 

A related problem occurs when the local model of the helicopter is used. The 
recursive identification algorithm is 


t 

n 


t 

n-i 


+ k (z 
n n 


z 

n-i 


A0 


^t ) = [I - k A0^]t ^ + k (z 

n n-i^ n n n-i n n 


n-i 


) 


When operating under closed-loop control, A0 should approach zero in the steady 
state (if it exists). In the limit of small A0, the Kalman gain approaches a 

finite constant. Hence kn A9^ is small and all the eigenvalues are near 1. The 
implication is that identif lability problems may also be expected with the local 
model, when A0 is small. 


Starting Recursive Algorithms 


The usual starting procedure for these recursive algorithms involves setting Pg 
to a very large value, and Tg to some initial estimate (see Mendel, 1973; Goodwin 
and Payne, 1977). Note that the limit Pg^ = 0 gives 

which could actually be used when only one parameter is being identified. With two 
or more parameters to be identified, is a singular matrix, and matrix inversion 

is undesirable in any case. This result does show, however, that large Pg is to be 
Interpreted as Pg » r/0^ Taylor et al. (1980)^used Pg/T ^ 10; as a result 
Pq/t = 100, which indeed was much larger than 6 

Some special procedures may be appropriate for the start of the algorithm* 

Molusis et al, (1981) used a prescribed set of initial control values followed by 
off-line least-squares identification to obtain initial values of Zq, T, and P, A 
stricter than normal limit on the magnitude or rate of change of the control could be 
used initially. In particular, the use of a time lag in the controller will prevent 
the implementation of a large, incorrect control at the start, if the initial esti- 
mate of T is too much smaller than the actual value. In general, care must be taken 
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In the use of the identified parameters until new measurements are obtained to update 
the estimates. 


Numerical Implementation 

Implementation of the identification algorithms requires procedures designed to 
minimize the numerical errors. Goodwin and Payne (1977) discuss such procedures for 
batch least-squares identification. Goodwin and Payne (1977), and Anderson and Moore 
(1979) discuss procedures for recursive identification (specifically, the square-root 
algorithm) . 

Two forms of the equations for P and k have been given (see Gelb, 1974; 

Anderson and Moore, 1979) . The second equation for P is less sensitive to numerical 
errors, and the second equation for k is more appropriate if r is small. Note 
that not all combinations of the two equations are possible: the first equation for 

P can be followed by either k equation; or the second equation for k can be used, 
followed by either P equation. In addition, the fact that P is symmetric can be 
used to reduce the required computation, and also to reduce the numerical errors. 


CONTROL 


The control algorithms will be based on the minimization of a performance index 
J that is a quadratic function of the input and output variables. This function will 
depend on the input and output at the nth time- step, and perhaps at past times, but 
not on the future values. If all the parameters in the model are known, a determinis- 
tic controller is obtained. With unknown, estimated parameters, the certainty- 
equivalence principle may be applied (without regard to the question of the validity 
of the principle): the deterministic control solution is used with the estimated 

parameter values. Alternatively, a cautious controller (Wittenmark, 1975 ) can be 
obtained by minimizing the expected value of the performance function. 

Such control systems are called passive-adaptive or nondual controllers 
(Wittenmark, 1975; Goodwin and Payne, 1977). The performance index does not consider 
that future measurements will be made, so it ignores the possibility of learning from 
the measurements. A dual or active-adaptive controller (Wittenmark, 1975; Goodwin and 
Payne, 1977) actively probes the system to reduce the parameter errors. The control 
is used for learning, to improve the parameter estimates, but the improvement is 
achieved at the expense of short-term deterioration of the closed-loop performance. 


Performance Function 

The quadratic performance function to be used is 


J 


T T 

z W z + 0 W „0 
n 2 n n 0 n 


+ A0V 

n A0 


A0 

n 


where A 0 ^^ = ®n “ ®n-i* vectors 0 and z contain the harmonics of the input and 

output. Typically the weighting matrices are diagonal, and have the same value for 
all harmonics of a particular quantity. Then J is a weighted sum of the mean 
squares of the vibration, loads, and control. The matrix Wq constrains the ampli- 
tude of the control, while W ^0 constrains the rate of change of the control. 
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To simplify the specification of the weighting matrices, they can be written as 
follows: 


W 


z 


= D 

z 


“e ■ “9/8 


where Dq, and are diagonal matrices. The factor g can be interpreted as 

the gain of the control loop, and x defines the time-constant of the control lag. 
The output vector z may include terms from several transducers, so D 2 can have 
different weights for each transducer (the values of the weights must also account 
for different units). Often the weights are the same for all harmonics of a particu- 
lar measurement. The matrices D 0 and may also have different weights (for 

example, to reflect different limits on the collective and cyclic actuators), and the 
weights may increase with harmonic number to account for the actuator frequency 
response characteristics. 


Deterministic Controller 

The control required to alleviate the helicopter vibration is found by substitut- 
ing for in the performance function, using the helicopter model, and then solving 
for that minimizes J. Both the global and local models of the helicopter can be 
written as 


z 

n 


z 


n-i 


+ T(e 

n 


0 

n-i 


) 


Substituting for z^ and setting 9J/90jj^ = 0 (for each component in the vector 9n) » 
gives a set of equations that can be solved for 0^. The result is 


0 

n 


Cz , + - CT)0 

n-i A0 n-i 


or 


A0 = Cz 


n* 


, “ C.0 
-1 0 n-i 


where 

C = -DT^W 

z 

S ■ ™9 


(t\t + Wg + Wjg)-' 

For the global model, a second form of the solution can be obtained by substitut- 
ing + T0^_i. The result is 
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or 


6 

n 


Cz„ + 


'^A6®n-J 


- «9 - “>Vl 

This equation defines an open-loop control determined by the uncontrolled response 
level (zq). The preceding result defines a closed-loop control obtained by feedback 
of the measured response (z^_j^). The open-loop case is applicable only with the 
global model of the helicopter. 

When W 0 - 0, the solution reduces to and for = 0, it reduces 

to ©n ” If both W 9 and are zero, then CT = -I, Finally, if 

^6 ~ ^A9 " number of controls equals the number of measurements (so T is 

a square matrix) then C = -T”^ (regardless of W^). 

From the above derivation it follows that the gains used to calculate 0^ should 
be based on the parameters (T and Zq) at the nth step. However, the recursive iden- 
tification algorithm obtains the estimate T^ only after the measurement z^, which 
is a result of the input, is obtained. The best that can be done is to use the 

a priori estimate T^^, which is the prediction of the parameter before the measure- 
ment is made. The model used here for the variation of the parameters gives simply 
^n “ "^n-i* Thus, the control gains are evaluated using the parameters identified at 
the (n - l)th time-step. 

The performance function used results in proportional control (feedback of z^_^ 
or Zq). An integral-proportional controller can be obtained by adding the term 


to J, where y is the integral of z: 


The control to minimize J then includes feedback of y^_^ as well (see Molusis 
et al., 1981). Such integral control is not considered further in the present paper. 


Controller Dynamics 

To examine the dynamics of the system using closed-loop control, substitute 
^n-i ” ^0 ^n-i the control law based on identified parameters: 

- [C(T - T) + + C(z, + v„.^) 

- BUi\(T - T) + w^ele_,_, - t\(z, + v„_p) 


where 

D - + W, + 
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The stability is determined by the eigenvalues of the matrix 


D(f\^(T - T) + W^g) 


The steady-state solution is 

e = z„ 

Z 0 


z = 



0 


where 


D* = (t\ T + W^)“^ 

z 0 

The dynamic response is determined by the estimation error (T - T) and the rate limit 
(W^ 0 ). If there is no estimation error and W ^0 = 0, the steady-state solution is 
reached in a single step: 

0 = 
n 

for all n. If W 0 = 0 and T is 
direct inverse: 


(regardless of the estimation error 
responds to the measurement noise. 

Using the identified parameters, the open-loop control is: 

0 = 
n 

The stability is determined by the 
solution is 

0 
z 

where 

D"'’ = (f^W f + W.)“^ 

^ z 0 

The transient response is due solely to the rate limit W^ 0 , If W ^0 = 0, the steady- 
state solution is reached in a single step. If W 0 = 0 and T is a square matrix, 
the steady-state solution is 


u^-TW z. + w . , 
z 0 A0 n-i 


eigenvalues of the matrix DW^ 0 . The steady-state 


= -D‘*’T^W z 
Z 0 

= z - TD‘‘'f'^W z. 

0 Z 0 


a square matrix, the steady-state solution is the 

0 = -T-^z„ 
z = 0 

or W^ 0 ). Note however that the system always 


0 


-T ^z 


0 


19 


which depends on the estimation errors. 

When the open-loop control is used with on-line Identification, it is necessary 
to consider the effect of the identification on the controller performance. The 
steady-state solution (if it exists) of the Kalman filter is 

z = Zp + T0 = Zg + T 6 

(whether or T, or both are identified). Hence the steady— state control response 

will be 

0 = -(t'^WJ + Wg)-^T^^[z^, + (T - T)0] 


or 


0 = -D*t'^W z 
z 0 

z = (I - TD*t\ )z„ 
z ^ 

which is identical to the result for closed-loop control feedback). Specifi- 

cally, the control system produces z = 0 if W 0 = 0, and T is a square matrix, 
even though the control is based on Zq (which includes estimation errors). Hence, 
in terms of the steady-state performance, the open-loop and closed-loop controllers 
are identical when used with on-line parameter identification. 

On-line identification influences the regulator dynamics by changing the param- 
eter estimates at each step. It is assumed that the parameters vary slowly enough 
that the identification and control problems can be separated in the design of the 
regulator. In fact, however, recursive identification produces a nonlinear feedback 
control system, because of the dependence of the Kalman-gain k on 0 , the dependence 
of the controller gains on ^, and the appearance of the combination T9 (since the 
parameter estimates as well as 0 are dynamic variables). On-line identification 
also makes the open-loop case a feedback control system, since X and Zq then depend 
on the measurement z^. However, the combination of open-loop control with on-line 
identification of only Zq is still a linear system, since in this case the Kalman 
gain is independent of the system control or response. 


Controller Gain Update 

With a new estimate of T, it is necessary to reevaluate the control gains, 
which requires 

D = (T^W T + W„ + W,^)“^ 
n n z n 0 A0 

The Kalman filter gives the parameter update in the form 


T = T + ek 
n n-i 
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where e and k are vectors. Matrix inversion can be avoided by using the 
relationship 


(A + - A“^B(I + C^A“^B)"^C^A ^ 

(see Sage and Melsa, 1971). Writing 

+ “d + "aO * '‘[(Cl * i ^ [(Cl + I ke^)u^e]k'' 


= D"^ + bc'^ + cb^ 

n~i 


there follows 


D = (A"^ + cb^)"^ = A - Acb^A/(l + b'^Ac) 
n 

A - o;;ii + - "n-i - Vi'>'=Vi'<' * <'\-i'’> 


Cautious Controller 


A cautious controller, which accounts for the parameter uncertainties, can be 
obtained using the expected value of the performance function (see Wittenmark, 1975 j 
Molusis et al. , 1981): 


j = Ely] w zM + + AeV A0^ 

I z. nn n 6 n n A0 n 

L j 1 J 

It is assumed here that W 2 is diagonal, and 0 is deterministic. For the case of 
closed-loop control (z^_-l feedback), there follows: 



using E(t) = t and E(tt^) = tt*^ + P. It is the actual value of z^ that is to be 
minimized, so the measurement noise is not included in the above expression. The 
parameter error variance matrix P is given by the Kalman filter (or it is calcu- 
lated directly for off-line identification). However, P^ is not available until 
after the solution for 6^^ is obtained. To avoid a very complex equation for 0^, 
the a priori estimate error 


will be used. This is consistent with the use of the a priori parameter estimates 
(t^ = ^n-i^ controller gains. Hence the performance function becomes 
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J = z^W,z + 0^W„9 + A0'^(W.„ + V w M, )A0 

n z n n 6 n n A0 z^ in n 


j 


The solution is identical to that for the deterministic controller, using the identi- 
fied values of the parameters , and with W ^0 replaced by 


”a9 Z ■ "ie “„(Z "^.0 

j J \j J / 


since The factor is introduced for an empirical modification of the 

controller if desired. 

For the case of open- loop control (zq feedback), there follows 

r„ .1 _r 


E w z^ = E w (z.. + 0^t )^l 

z. jn Z-rf -z ' jO n jn'' 

Lj J J j ■- J J 


= w, (z.„ + 0 ’^t, )^ + w (M + 20^M^ + 0^M 0 ) 

z jO n Jn Z-# z. zz n tz n tt n'^ 


where 


M = 


tt tz 

T 

M 

tz zz 


So the performance function becomes 


J = z’^W z + 0^W„0 + (0 

n z n n 0 n 




+ A0 W^.A0 
n A 6 n 


The solution for the control that minimizes J is then 

0 = Cz. + C,-0 , + c 

n 0 A0 n-i 0 

The gain matrices C and C ^0 are the same as for the deterministic controller, using 
the identified values of the parameters and with W 0 replaced by 


“e + »tt> 


The new constant term is 


■(? 
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If only the T-matrix is identified, the Cq term is not present. If only Zg is 
identified, the cautious controller is not applicable (since it is Identical to the 
deterministic controller then) . 

In summary, the cautious controller introduces for the closed-loop case a con- 
straint on the rate of change of the control (an effective value of proportional 

to the current parameter error-variance. For the open-loop case, a constraint on 
control magnitude (effective W 0 ) is introduced, and an offset (cq) if Zq is being 
identified. These are the changes required to obtain the minimum expected value of 
the mean— squared response when the parameter estimates are in error. 


Dual Controllers 

Optimal dual controller solutions are generally too complex to be practical 
(Wittenmark, 1975) > but there has been work on suboptimal solutions that introduce 
learning in some fashion. There are very simple approaches, such as adding a pertur- 
bation signal to the cautious controller, or constraining the minimum control level 
(Wittenmark, 1975). A dual controller is defined by the minimization of a multistep 
performance function: 


N 

"d- E 

n=i 


n 


where is the one-step function used above. The solution for the general stochas- 

tic problem is not practical for the present purposes. Molusis et al. (1981) obtained 
an approximate solution by linearizing Jj) about the one-step control law. The 
resulting dual controller is similar to a reduction of the weight in a cautious 

controller (Molusis et al. , 1981). Another approach is to add a term to that is 

a function of the estimation error (Wittenmark, 1975): 


■^D = 


J + 
n 




for example, G = in\?^\ (Goodwin and Payne, 1977). Alternatively, can be mini- 
mized subject to an additional constraint, such as Tr > X (Wittenmark, 1975). 

A simple learning controller can be obtained by using G = -|Mj^j/|Pn|> where 
is the estimation error before the measurement, and P^ is the error after the mea- 
surement (Goodwin and Payne, 1977). From the Kalman— filter equations it follows that 



1 + e^M e /r 
n n n n 


so the performance function becomes 


= J - X^e M 0 /r 
D n D n n n n 


T T 

Recall that **6^^" is interpreted as for the local model, or as (0^ 1) , if both 
T and z^ are being identified. This performance function has the same form as that 
for the cautious controller, hence the same solution is obtained, with now 
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c 



Hence, ^ the cautious controller, and X^. < 0 for a learning controller. 

The learning controller introduces an effective contribution to Wq or equal to 

» so the constraint on the control is reduced by an amount proportional to 
the parameter error-variance. There is also an offset term (cg) if Zg is being 
identified. This learning controller is convenient since it leads to a quadratic 
form for Jp. However, a large and negative effective value of Wq or W^q can pro- 
duce a divergence of the control. 


REGULATORS 


A controller combining recursive parameter estimation and linear feedback is 
called a self-tuning regulator (Astrom et al. , 1977; Astrom and Wittenmark, 1973; 
Goodwin and Payne, 1977). The most common configuration consists of recursive least- 
squares parameter estimation and a minimum variance controller. Self-tuning regu- 
lators have been developed for systems with constant parameters, but there have also 
been applications to systems with slowly varying parameters (Astrom et al. , 1977). 
Usually the system model includes the dynamic behavior. Other estimation methods 
(e.g. , exponential window, extended least squares, or maximum likelihood) and other 
controllers (e.g., quadratic cost function) have been used (Astrom et al. , 1977). 

The self-tuning regulator and the plant form a time-varying, nonlinear, stochastic 
system. Of concern are the stability of the system, the convergence of the regulator, 
and identlfiability when the system operates closed-loop (Astrom et al. , 1977). There 
are some theoretical results for the least— squares identification and minimum— variance 
controller combination, but primarily these issues have been investigated by 
simulation. 


Classification 

In the present work, self-tuning regulators are constructed for the alleviation 
of helicopter vibration using multicyclic control. The most general case involves 
recursive identification, using a Kalman filter, and a quadratic performance function 
controller. There are two fundamental options for the identification: the use of 

either an invariable algorithm or an adaptive algorithm. For the invariable algo- 
rithm, the constant parameters are identified off-line by applying the least-squares 
method to a succession of independent input and output measurements. For the adaptive 
algorithm, the parameters are recursively identified on-line, using a Kalman filter 
(or possibly the exponentially weighted generalized least-squares method) . 

There are also two fundamental options for the controller: open-loop or closed- 

loop algorithms. For the open-loop algorithm, the control is based on the uncon- 
trolled vibration level Zg (identified either on-line or off-line). For the closed- 
loop algorithm, the control is based on feedback of the measured vibration, Zj^_u^. 

Hence, there are four regulator options. The Invariable open-loop regulator 
consists of off-line identification of T and Zq, calculation of the con- 
troller gain, and then application of the fixed control 0 = Cz„ (W^g = 0 must be 
used). This is the simplest and most stable option, but it may be expected to have 
poor performance if the parameters vary or are estimated Incorrectly. 
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The invariable closed-loop regulator 
(fig. 4) consists of off-line identifi- 
cation of the parameters and calculation 
of the fixed-gain matrix, and feedback 
of the control based on the measured 
response. The feedback improves the 
steady-state performance, although it 
also means the control will respond to 
measurement noise. The loop closure 
introduces concern about dynamic stabil- 
ity, particularly with estimation errors 
or varying parameters. 

The adaptive open-loop regulator 
(fig. 5) consists of on-line identifica- 
tion of the parameters and calculation 
of the gain matrix, with control based 
on the identified value of Zq- The 
performance of the system is expected 
to be increased by use of on-line iden- 
tification to reduce the parameter 
errors . 

The adaptive closed-loop regulator 
(fig. 6) consists of on-line identifi- 
cation of the parameters and calcula- 
tion of the gain matrix, with feedback 
of the control based on the measured 
response. Note that the Kalman-f ilter 
gains can be calculated in the time 
interval between application of 0^^ to 
the helicopter and the measurement of 
the resulting z^^. This regulator, 
using both feedback control and on-line 
parameter identification to improve the 
system performance, is the most complex 
option. Figure 6 illustrates identifi- 
cation using the global model of the 
system. The regulator using the local 
model has the same form, except that 
Zq is not identified. 

Several models of the helicopter 
have been discussed, particularly with 
regard to the identification algo- 
rithms; however, not all of these models 
are appropriate for each regulator. 

With off-line identification, it is not 
possible to identify only z^, since the 
least-squares method is required to 


OFF-LINE IDENTIFICATION OPEN-LOOP CONTROL 



Figure 3.- Invariable open-loop regulator. 

OFF-LINE IDENTIFICATION CLOSED-LOOP CONTROL 



Figure 4.- Invariable closed-loop regulator. 


identify T. Off-line identification of only T by the least-squares method is pos- 
sible, since Zq can be measured directly by setting 0=0. For the adaptive open- 
loop regulator, the global model with only T identified is not appropriate, because 
the controller requires Zq. On-line identification of only Zq (with off-line 
calculation of T) is feasible for the adaptive open-loop regulator. For the 
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OPEN-LOOP CONTROL 


ON-LINE IDENTIFICATION 



Figure 5.- Adaptive open-loop regulator. 


CLOSED-LOOP CONTROL ON-LINE IDENTIFICATION 



Figure 6.- Adaptive closed-loop regulator. 


adaptive closed-loop regulator, on-line 
identification of only T (with off-line 
calculation of Zq) is possible. The 
global model with on-line identification 
of only Zq is not appropriate for the 
adaptive closed-loop regulator, since the 
system then reduces to the invariable 
closed-loop option. Finally, the local 
model is not appropriate with off-line 
identification, and it cannot be used for 
the adaptive open-loop regulator (which 
requires z q) . 

In summary, the global model with 
identification of both Zq and T can be 
used with all four regulator options. 
Identifying only T is possible for all 
options, except the adaptive open-loop 
(zq must still be estimated, of course, 
by direct measurement for the invariable 
options or by off-line identification for 
the adaptive option). On-line identifica- 
tion of only Zq can be used for the 
adaptive open-loop regulator, and the 
local model can be used for the adaptive 
closed-loop regulator. 


Previous Work 

Previous work has been reported on 
the application of each of these four 
regulator options. Table 1 summarizes 
these investigations (see also the discus- 
sion of previous work in the Introduc- 
tion) . The work has been both experimen- 
tal and theoretical. The identification 
techniques considered include the off-line 
least-squares method; recursive estimation 
by a Kalman filter; and direct inversion 
of the measured data (when the number of 
independent control inputs equals the num- 
ber of controls). The controller gains 
have been determined by (1) minimizing a 
quadratic performance function, sometimes 
with weights on the measurements and con- 
straints on the control; (2) minimizing 
the expected value of the performance 
function (the cautious controller); and 
(3) by direct inversion of the T-matrix 
(when the number of measurements equals 
the number of control variables). 


The invariable open-loop regulator has received the most attention. Although 
these investigations have been based primarily on experimental data, there has been 
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TABLE 1.- SUMMARY OF PAST WORK ON REGULATORS FOR HELICOPTER VIBRATION ALLEVIATION 
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Included in the theoretical development, but not used in applications. 



no experimental confirmation of the regulator performance when the open-loop control 
is applied. The open-loop control required has been calculated using the measured 
T-matrix, and the response resulting when this control is applied has been predicted. 
The investigations have considered blade loads (McCloud and Kretz, 1974; Kretz et al. , 
1973a, b; McCloud, 1975; McCloud and Weisbrich, 1978), hub reactions (McCloud, 1975; 
Sissingh and Donham, 1974; Powers, 1978; Wood, Powers, and Hammond, 1980), and 
accelerations (McCloud and Weisbrich, 1978; Brown and McCloud, 1980). 

There has been both experimental and theoretical work on the invariable closed- 
loop regulator, including some direct experimental verification (Shaw and Albion, 
1980). The vibration was successfully nulled at one speed, but not at higher or 
lower speeds, because the control authority was exceeded. The transient characteris- 
tics of the controller were good. 

The performance of the adaptive open-loop regulator has been tested in terms of 
its starting response, ability to track speed variations, and behavior with collective 
changes (Molusis et al. , 1981). There has been partially successful experimental 
verification of the vibration reduction using this regulator (Hammond, 1980; Molusis 
et al., 1981). Three quantities were controlled, using the three swashplate inputs, 
but only two were significantly reduced; the roll moment (Hammond, 1980) or lateral 
acceleration (Molusis et al. , 1981) was only slightly reduced, or was even increased. 
Molusis et al. (1981) considered six controllers in the adaptive open-loop class: 
deterministic, cautious, and dual forms with both T and Zq identified; and a deter- 
ministic form with only Zg identified, including perturbation and proportional- 
integral feedback variants. In their terminology, the first three controllers were 
called adaptive and the last three were called gain— scheduled (since the gains depend 
only on T). The perturbation variant should be identical to the basic controller 
with only z^ Identified, since the T-matrix perturbation was not included in the 
controller-gain calculation. The cautious controller was most satisfactory, achieving 
the minimum vibration within a few iterations after starting, with smooth control 
variations and no indication of drift in steady conditions. The controller tracked 
well with velocity changes. The deterministic controller was more erratic in opera- 
tion; introduction of a rate limit produced smooth control variations, but the system 
was then considered too sluggish. The regulators with only Zq being identified were 
not successful in reducing the vibration (it was conjectured that the failure was due 
to nonlinearity in the T-matrix) . 

The performance of the adaptive closed— loop regulator has been examined in terms 
of the starting response (Taylor et al. , 1980) and the response to abrupt changes in 
the parameters (Shaw, 1980). There has been no experimental verification of this 
regulator. Only the local model has been considered. Taylor et al. (1980) found that 
a limit on the maximum control increment was needed for smooth operation (|A0| <0.1° 
in a single step, for each harmonic). They also examined the influence of the time- 
step and measurement noise on the system performance. An update interval of two 
revolutions produced somewhat smoother response, but the system converged faster with 
a one revolution increment. With a measurement noise level above 20% of the uncon- 
trolled response, the regulator did not converge. Taylor et al. (1980) actually 
identified as well as T, which leads to inconsistencies. They considered the 

helicopter model in the form 
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Hence at the (n - l)th step, z^-i was a measurement; at the nth step, became 
a parameter* Furthermore, the model of the parameter variation used with the Kalman 
filter gives “ ^n-2 ^^n-2 * which is not consistent with the helicopter model, 

^n-i “ ^n-2 “ ^n-2^* 


ANALYSIS AND SIMULATION 


The regulators that have been defined in the preceding sections must be analyzed 
in more detail, in order to further develop useful designs for helicopter vibration 
alleviation* Of concern regarding the on-line identification are the transient 
behavior and convergence; identif iability; and the selection of the parameters in the 
algorithm* Of concern for the controller are the interpretation and selection of the 
weights in the performance function; the possible use of cautious or dual controllers; 
and the stability and steady-state performance of the controlled system, including 
the effects of measurement noise, parameter-estimation errors, and nonlinear or time- 
varying parameters* Some of these issues will be examined here by considering a 
system with only one measurement and one control. The actual helicopter problem 
involves sine and cosine components for each harmonic, and usually at least three 
harmonics or variables for the input and output. The single- input and single-output 
case is useful however, because of the simplifications that result from dealing with 
scalar equations* The identification proceeds by rows in fact, so with a single 
input there actually is a scalar equation in the identification algorithm for each 
measurement. The weighting matrix then is used to balance the control of the 

various output variables (the specific influence of W2 depends on the elements of 
T). For the general multi- input and multi-output case, it is necessary to deal 
directly with the matrix equation given above* 

The characteristics of the regulators will be analyzed in the following sections 
by examining the equations for the case of a system with only one measurement and one 
control. In addition, numerical simulations were performed for several of the cases. 
The general behavior exhibited in the numerical simulations will be described, 
although it is not considered appropriate to present quantitative results from simu- 
lations of such a simple system. 


Open-Loop Control 


For open- loop control, involving feedback of the uncontrolled vibration level, 
the deterministic controller is 


0 

n 


= Cz, 


‘^A0®n-i 


(-TW z„ 

Z 0 




+ + 


“a6> 


With a single output, W2 is not relevant; it is retained however, to aid in the 
interpretation of the parameters for the multivariate case. For the invariable^ open- 
loop regulator, W^0 must be zero; for the adaptive open-loop regulator, T and Zq are 
the estimates at the (n — l)th step. The stability of this controller is determined 
by the eigenvalue 


X = 




+ w. 


«A6> 
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The corresponding time-constant is 


T = AtX/(l - A) = AtW^g/(T^W^ + Wg) 

so the time lag is directly proportional to W^e/T^W^,. The time lag is reduced by 
W 0 , but 

T/At ^ ^A9 

0 /@ ^2tt 

ss' 0 T 

where 9gg is the steady-state response (given below). So the rate limit, which is 
proportional to ^ 33 /'^ > independent of Wq. 

The steady-state limit of the controller is 

8„ - + "e> 

(which is reached immediately if = 0), Now define Gq as the solution of 

z = Zq + T0 = 0, and let Tq=T at 0=0^. Similarly, 0 q is the solution of the 
equation using the estimated parameters, z = Zq + T9 = 0; hence Gq = -Zq/T. Then 
the steady-state control is 


e/Gj, = 1/(1 + Wg/f^w^) 


and the system response is 

z/zq = (1 - TZg/fzj, + Wq/T^W^)/( 1 + Wg/T^W^) 

The response in the presence of parameter errors depends on both T and Zq, which may 
have either canceling or reinforcing effects. Hence, it is clearer to write the 
response in terms of the error in the estimate of 6q: 

z/zg = (1 - T0o/T(,9(, + Wq/T^W^)/( 1 + Wg/T^W^) 

With no estimation errors, the result is 

z/Z(, = (Wg/T^W^)/(l + Wq/T^W^) = 1 - 6 / 6 ^ 

Note that a feedback control law of the form 0 = -Kz gives z/zq = 1/(1 + KT) , which 
implies KT = T^W 2 /W 0 . Thus, W 0 may be interpreted as the inverse of the gain. 


Closed-Loop Control 

For closed-loop control, involving feedback of the measured vibration, the 
deterministic controller is 

0„ = Cz + (I - C.)0 ^ 

n n-i 0 n-i 
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where T is the estimate at the (n - l)th step. To examine the closed-loop perfor- 
mance, substitute = Zq + ^n-i» obtain 


e = 

n 


{-TW^Zo 


+ [T(T - T)W^ + 


^AelVx 


- TW V ,} 
z n -1 


where 


A = + Wg + 


It is assumed that the parameters vary slowly enough to be considered constant for the 
present purposes. Nonlinear behavior of the real system will be allowed however, so 
T = T(0n_^). Note there are no dynamics in the helicopter model, since the quasi- 
static assumption gives a model of the form = f(9n)« The dynamics are introduced 
by the control law. An equation for the response is obtained by substituting 
®n = - Zq)/T in the controller equation, and including the measurement noise in 

Zn-i- For a linear system the result is 


z 

n 


■ I 


[T(T - T)W + W..]z , - TTW v ,} 

^ ^ ' z A0 n-i z n-i 


Here z is the true response of the system, without the measurement noise. 

For the ideal case, a linear system with no estimation errors, these equations 
reduce to 


0 =4 (-TW z„ + - TW V ) 

n A z 0 A0 n-i z n-i 


z =4 (W^z + W^^z - T^W V ) 
n A 0 0 A0 n-i z n-i 


The eigenvalue is 


^ + "e "a9> 


and the steady-state solution is 

e/Gg = 1/(1 + Wq/t^w^) 

z/zg = (Wq/t 2 w ^)/(1 +Wg/T^W^) 

If the system starts with 0^^ = 0, then Zj^ = Zq and 

e, . -TW^Z,/(T%^ +W^j) 

^2 - ^(We + + «9 + “a6> 

It is observed that the eigenvalue is the same as in the open-loop case. The time lag 
is again determined by This ideal system is always stable (|a| < 1). The 

steady-state solution is also the same as that for the open-loop case (for no estima- 
tion errors); hence, the interpretation of W 0 is the same. If W ^9 = 0, the 
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steady-state solution is reached immediately (at n = 2). The steady-state response 
to the measurement noise is 

a^/r = (TW^/A)V[1 - (W^q/A)'‘] 

= (TW^)V[(T^W^ + WgKT^W^ + Wg + 2W^g)] 

and = To 0 . Here Oq and a| are the mean-squared responses of 6 ^^ and Zj^ to the 

noise v^, which is a Gaussian random variable with zero mean and variance E(v^) = r. 
These results can be written 

(a^/e^)/(r/z;) = (T^W^ + Wq)/(t2w^ + + 2W^g) 

(o^/z^)/(r/zp = (e/0g)2(T2w^ + Wg)/(X2W^ + + 2W^g) 

which are both order one. The rate limit reduces the response to measurement 

noise. 

For a linear system with estimation errors, the eigenvalue is 
X = [T(T - T)W^ + W^q]/(tX +Wg + 

= (1 - T/T + W^q/T^W^)/[ 1 + (Wg + W^q)/t''w^] 

For stability, |x| < 1, it is thus necessary that 

-Wq/T^W^ < T/T < 2 + (Wg + 2W^g)/T^W^ 

If Wq = W^Q = 0, the criterion is that 0 < T/T < 2; that is, the estimated value of 
T must have the same sign and at least 50% the magnitude of the true value. It is 
found that this result is unchanged by the addition of the steady-state Kalman-f ilter 
dynamics. The control constraints W 0 and W ^0 improve the stability range. The 
steady-state solution is now 

0 = (-z^/T)/(l + W^/TTW^) 
z = Zq(Wq/TTW ^)/(1 + Wq/TTW^) 


So with feedback of Zn-i» steady-state response is not sensitive to estimation 

errors, except for a ciiange in the influence of W 0 . Specifically, with W 0 = 0, the 
null response z = 0 is always achieved. Feedback of the measured vibration intro- 
duces a response to measurement noise however, and estimation errors do influence the 
system stability. The stability range is large, but on-line identification is still 
likely to be required for the helicopter problem. 

For a nonlinear system, T( 0 j^_ 3 ^) must be used in the equation for The 

steady-state solution is still given by the above equations. Now an explicit equa- 
tion for the control is not possible, since T depends on 0; but still, z = 0 is 
achieved if Wq = 0. Convergence and stability of the nonlinear equation for 0 ^ 
are difficult to examine analytically, but the local stability can be calculated. 
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Consider the nonlinear equation 0^^ = a + b(0n-i)6n-i» ^ solution 0 * of this 

equation for the specified initial conditions. For a perturbation about this solu- 
tion , the linearized equation is 

60 = (b + 0 3b/90)6e 

n ^ ^ n-i 

where the coefficient is evaluated at 9 = Hence the eigenvalue is 

X = b + 0b' = J [T(f - T - 0T')W^ + 

for the present problem, and the stability criterion becomes 

-W„/T^W < (T + 0T')/T < 2 + (W^ + 2W,„)/T^W 

O Z U A o Z 

So the estimate T must be close to T + 0T’ , which is just the local slope of the 
response z( 0 ). 


Caution and Learning 

Accounting for uncertain parameters in the performance function has the effect 
for open-loop control of replacing Wq with (Wq + and introducing the 

of f set 


= -X DM^ W 
c tz z 


if Zq is identified. For the cautious controller, X^ *= 1 . The open-loop control 
algorithm than becomes 


9 = (-TW z - M W 

n z 0 tz z 


+ W..0 J/(T^W + W. + W.„ + M W) 
A0 n-i z 0 A0 tt z 


which has the steady-state solution 


0/0p = (1 + M^^/TZg)/(l + Wq/T^W^ + M^^/T^) 

^ ^ 1 - (T0o/To0o)(l + \ + Wg/T=^W^ + 

^0 1 + W„/T^W + 

u z tt 


With parameter errors there is a shift in the control required to obtain the minimum 
expected value of J. The control is always decreased by an error in f, while 
can produce a control change in either direction. 


For closed-loop control, W ^0 is replaced by (W^q + ^c^tt^z^* where again X^ = 1 
for the cautious controller. The control algorithm becomes 


0 = [-TW z + 

n z n-i 


(T^W + 


"a 6 + "z ”e + % 


M W ) 
tt z^ 


The steady-state solution is not influenced by the caution in this case, but the 
response to measurement noise will be decreased and the stability range increased. 
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The effectiveness of the caution is determined by the normalized squared errors, 
and For example, an rms error of 20% gives = 0.04, which 

would produce only small changes in 0 and z. To have a significant influence of the 
caution, must be order one, which implies an extremely large estimation error. 

It is probable that the regulator performance would be unacceptable with such large 
errors. The recursive identification algorithm is often started with extremely large 
values of Pq (typically P 0 /T^ - 10). The caution would then be active at the start 
and would have the effect of limiting or smoothing the control until the parameters 
are estimated well. However, Wq or W ^0 could be used instead, with the same effect. 
Also, the identif lability problem with a closed-loop system can lead to large estima- 
tion errors for individual parameters, which would be reflected in large values of 
the error variance P (although P/T^ could still be small). The caution could 
become effective in this case. 

Recall that a form of learning controller can be obtained by using ^ 

control diverges at ^c^tt^^^ ” ” ^A 0 ” learning to be effec- 

tive however, the magnitude of ^c^tt/"^^ must be order one. Hence this learning 
controller operates near the divergence, and with a much reduced stability range for 
the closed-loop control. These characteristics make this type of dual controller 
unacceptable. 


Adaptive Identification 

To examine the characteristics of the recursive parameter identification, con- 
sider the algorithm for the identification of T in the global helicopter model: 

T = T + k (z - z - T 0 ) 
n n-i n n o n-i n 

where 


m = p + q 
n ^n-i ^n-i 


p ^ = m ^ + 0^/r , or p = m r / (r + m 0^) 

^n n n n ^n n n n n n' 


k = p 0 /r =m 0 / (r + m 0 ^) 
n ^nnn nn n nn 


The generalized least-squares solution is obtained by setting q = 0: 



n-i 


+ 0Vr 

n n 



n 


+ E 

i=i 




r . 
1 


k 

n 


0 /r 
n' n 


n 




i=i 


For the least-squares case, r^^ = constant; therefore, k^ = ©n/^^i approaches zero as 
n increases. This algorithm is not appropriate for recursive identification because 
it shuts off. As data are acquired, each new piece of information is worth less and 
less compared with the accumulated knowledge. In contrast, by using the exponential 



window method, each succeeding measurement is weighted more highly. With 
r^ = a^(0 < a < 1) , the solution for p* = is 


Note that 


n n-i 

^ n 2 


1/p* = a/p* + = a"/p + y) e?a = ^ 6^ .a 

^n ^n-i n i n-i 

1=1 1=0 


k = p’^e = 

n ^n n n-i 


E 

n-i 

i=o 


n-i , , n 

L i 1 - a 
a = 


i=o 


1 - a 


so in the steady— state limit, when 0 is constant for the closed— loop system, 
p* = 0^/(1 - a) and k = (1 - a)/9. In numerical simulations of the exponential- 
window filter, good results were obtained when a was small. 


The Kalman filter is obtained for q > 0. In the limit of no measurement noise, 
r = 0, the solution is p^ = 0 and = 1/6^ (which is independent of q). This 
result reflects too much confidence in the latest measurement, but it is useful for 
comparison with the general solutions. The properties of the Kalman filter can be 
examined in the steady-state limit (disregarding the question of whether the steady 
state exists). The system is controlled, so 0 is constant in that limit. Hence the 
equation for p has the solution 

p/q = (1/2) [-1 + (1 + 4r/02q)^/^] 


and ke = p6^/r = (p/q)(0^q/r). For small r/0^q then: 


p/q s r/0^q - (r/0^q)^ 
k0 s 1 - r/0^q 


and for large r/0^q: 

p/q s (r/0^q)^/^ 
k0 s l/(r/0^q)^/^ 

Note that 0 < p/q < r/0^q for finite and nonzero r/0^q, so 0 < k0 < 1 or 

|kj < 1/|0|. Hence the Kalman-gain k is always smaller than the solution for zero 

measurement noise (r = 0). 


When 


Zn = Zq 


+ t0^ + V. 


‘'n 


T 

n 


is substituted 

(1 - k 9 )T ^ 
n n n-i 


, the Kalman filter becomes 

+ k 0 T + k V 
n n n n 
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The dynamics of this equation will be examined separately, although in fact the filter 
and controller form a coupled system. Note that in general (1 - ” Pn^^i* '^^ich 

is positive and less than 1. In the steady-state limit, is constant, so the 

filter equation is time-invariant with eigenvalue X = 1 - k9. Recall 0 < k0 < 1 , 
so 0 < X < 1; the filter is stable. For small r/6^q 

X = r/e^q = 0 

and for large r/0^q 

X = 1 - l/(r/9^q)^/^ = 1 

Now X = 0 implies immediate convergence, = T; and X = 1 implies no convergence 
at all, = ^n-i* hence a large value of q is better than a large value of r. 

The limit q/r =0 is the least-squares algorithm, so the tracking ability will be 
poor for large r/9^q. The converged solution of the filter is T = T, unless X = 1 
exactly. The filter response to the measurement noise is 

o^-/q = (r/0^q)/(l + 4r/9^q)^/^ 

The mean-square response of the identified parameter, a^, is large for large values 
of r/6^q. 

In general, the solution for small values of e = r/0^q is 


r / 0^q 
n n^n-i 


+ 0 ( 0 =") 


So p/q is order e small always. This result gives the steady-state solution and 
the limit r = 0 properly too. If the solution is started with 1 /Pq = 0, then 
p^ = r^/0^. So pj^ immediately has the order required for the small r/0^q 
solution. 


The general solution for large values of r/0^q is 


where tt = p/q and e = 0^q/r. This equation is valid only if |*ir| < that is, 

if p/q is smaller than order Indeed, this equation eventually gives p/q 

order £ which is the proper steady-state solution also. If p/q is order 

e however, the solution to lowest order is 


Vi^Pn = 


Again, 1 /Pq = 0 gives p^ = So this order solution is encountered at 
the start of the algorithm, and whenever p/q becomes too large. If the order e” 
solution proceeds for N steps, then 


q /p = 

^n- 1 ^n 


N steps 
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So eventually p/q becomes smaller than order e” , and the order e ^ solution 
is encountered. The number of steps that the solution remains order e is 
inversely proportional to e. In the limit e = 0, the order e ^ solution is 
always valid; in fact, the equation above is the exact solution for e=q9/r=0 
(namely, the least-squares limit). 

For the global model, it is anticipated that 

e"q/r = (eVe^)(q/T2)/(r/z2) 

will be order one for typical values of q and r. For the identification of Zq, the 
corresponding parameter 

q/r = (q/z^)/(r/z2) 

should also be order one. With the local model however, " 6 " is interpreted as A0, 
and 

AG^q/r = (A 0 ^ /0 q ) ( q/T^ ) / (r /z ^ ^ (AG/0 q)^ 

will be small. Hence, difficulties may be anticipated with identification of the 
local model. In numerical simulations of this case, the estimate of the local T 
diverged in the presence of measurement noise (the filter shuts off without measure- 
ment noise). The controlled response remained acceptable however. The system was 
stable because the estimate of T was greater than the true value. The divergence of 
the estimate was not eliminated by the use of ^^ 0 , a large value of q, a limit on 
the minimum magnitude of A0, or caution. The estimate did not diverge when T 
varied with time, although the tracking ability of the filter was not as good as when 
the global model was used. 

Ident if lability 

When both Zq and T are identified, the Kalman filter is 



In the steady state, where 0 and the Kalman gains are constants, the eigenvalues of 
this equation are X = 1 and X = 1 - - k0, with corresponding eigenvector matrix 



As discussed above, the X = 1 eigenvalue reflects the problem of identifying two 
parameters with one measurement for a closed-loop system. In numerical simulations of 
the above equations, the identified parameters diverged in the presence of measurement 
noise, with Zq + T0 remaining near the correct value. The estimated value of T 
was large, so the controller was stable, and the controlled response remained accept- 
able. The use of W ^0 or caution did not improve the identif lability . The estimates 
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did not diverge when the parameters varied with time, although the undamped (zq + T9) 
mode was still evident. 

Some of the phenomena encountered by Molusis et al. (1981) in tests of an adap- 
tive open-loop regulator are consistent with the use of a cautious controller in the 
context of the identif iability problems with a closed-loop system. They were identi- 
fying 42 parameters, using six measurements, so a large parameter variance P would 
be expected in steady-state conditions. Direct evidence of the identif iability prob- 
lem is provided by the fact the T-matrix obtained by on-line identification was not 
the same as that obtained by off-line identification, and by the observation that the 
T-matrix identified on-line was not repeatable. A large value of P would make the 
caution effective, which is consistent with the fact that the cautious controller was 
smoother than the deterministic controller, and with the observation that the weight- 
ing matrix influenced the solution (Hammond, 1980) (those are the influences 

of the effective control weight W 0 due to caution). That the roll moment or 
lateral acceleration was not reduced could also be due to a large effective value of 
Wq. The observation that during speed changes the controller actually maintained the 
vibration below the levels obtained in steady conditions is consistent with reduced 
caution resulting from improved identif iability when the parameters vary. There are 
however other factors, such as nonlinearity, that might account for some of these 
effects. The argument is also contradicted by the statement that the same stabilized 
condition was approached with the deterministic controller as with the cautious 
controller (Hammond, 1980). 


Adaptive Open-Loop Regulator 

For the combination of open-loop control and on-line identification, the coupled 
controller and filter dynamics must be considered in order to analyze the regulator 
performance. The steady-state solution (if it exists) of the Kalman filter is 

z = Zq + T0 = Zq -h T0 

In this result, either Zq or T may be estimated on-line, and the other parameter 
obtained from off-line calculations; or both may be identified on-line. A linear 
system is assumed, but T may be the local derivative of z(9). The Kalman-gains 
influence the convergence of the filter, but not the steady-state solution. Using 
the open-loop control solution, the steady-state response of the regulator is then 

e = [-TW^/(T^W^ + Wg)][Zo + (T - f) 6 ] 

= (-Zo/T)/(l + Wq/TTW^) 
z = Zo(Wg/TTW^)/(l + Wg/TTW^) 


which is the same as the closed-loop control result. The response depends on the 
actual response Zq rather than the estimate Zq, because of the on-line identifica- 
tion, Recall that the open-loop response depends on the error in 9 q. From 
Zq + T0 = Zq + T0 it follows that 

T/T = (zo/zgHl + Wq/T^W^) - Wq/T^W^ 
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and so 


Zq/Zq = (T/T + Wq/T^W^)/( 1 + Wg/f^W^) 


1 - e,/0„ = 1 - Tz„/Tz„ = (z„/z<, - iHWg/T^W^) 

= (1 - T/T)(Wg/T^W^)/(T/T + Wg/T^W^) 


which is zero regardless of the parameter errors if Wq = 0. The filter identifies 
one or both parameters such that the measured value of z will be predicted cor- 
rectly. Hence the parameter errors must compensate in the vicinity of this value of 
the response. With a controlled system the response will be small, so the error in 
the estimate of 0 q (where z = 0 ) should be much smaller than the error in the indi- 
vidual parameter estimates. Thus the regulator has good closed-loop performance. 


When only Zq is identified, the equations for the filter and controller are 


-■n 


= z 


■ On-i 


+ k (z - z 


n n 


°n-i 


- T9) 


6 =Cz« 

n On-i A0 n-i 


This system is linear. Although kj^ varies with time initially, it depends only on 
and r^, not on 0^ in this case. Assuming that q^ and r^^ are constant, it is 
appropriate to use the steady-state solution for kj^. Substituting for 
^n “ ^0 *^®n ^n gives the equations 

" / 



In the ideal case, with no error in the estimate of T, the filter is decoupled from 
the controller. The estimate Zq^^ follows Zq + v^ (actually measured as - T0^) 

with a first-order lag (X = 1 - k) . Then the control 0^^ follows Zq^ with a lag 
due to W/^Q (X = and the response is determined by 0^- The steady-state 

response of the filter to the measurement noise is 

ol/r = k /(2 - k) 


where Oq is the mean-squared response of Zq^ to the noise v^, which is a 
Gaussian random variable with zero mean and variance E(v^) = r. Then the mean- 
squared response of the control 0 ^ is 



The first factor in 00 identical to the response of the closed-loop controller to 
measurement noise. The product of the last two factors is always less than 1, so the 
adaptive open-loop regulator has a smaller response to noise than does the closed loop 
controller. The eigenvalues of the coupled system are the solutions of 
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- [1 - k + k(T - T)C + C^q]X + (1 - k)C^g = 0 

If T = T, the filter and controller are decoupled and the solutions are X = 1 - k 
and A = C^ 0 . In general, the criterion for stability (|a| < 1) is 

-Wg/T^W^ < T/T < 1 + [(2 - k)/k][l + (Wg + 2W^g)/T^W^] 

If W 0 = W ^0 = 0, the system is stable if 0 < T/T < 2/k. Since k < 1, the stability 
range is larger than for the closed-loop controller. 

In numerical simulations of the adaptive open-loop regulator, good performance 
was obtained when only Zq was identified, although the ability to handle a system 
with a time-varying value of T was not very good. In wind-tunnel tests however, 
Molusis et al. (1981) found that the regulator using identification of Zq only was 
not successful in reducing the vibration. 


CONCLUSIONS 


Self-tuning regulators for the multicyclic control of helicopter vibration have 
been examined. The topics considered have included the selection of the parameters 
for the identification and control algorithms; the best combination of identification, 
control, and helicopter model options for the regulator; and the regulator perfor- 
mance, involving steady-state response, stability, convergence, and identif iability . 

Regarding the identification algorithms, it is concluded that the values of the 
parameter variance and measurement noise variance must be correctly chosen for proper 
performance of the regulators. The use of the Kalman filter is preferred to the 
exponential-weighted generalized least squares, since the former is more flexible and 
the theory provides a guide for the choice of the parameters. 

Regarding the controller algorithms, the analysis has provided guidelines for 
the choice of the parameters. The use of the largest value of W ^0 that does not 
make the response too sluggish is appropriate, to improve the transient response, the 
sensitivity to measurement noise, and the sensitivity of the stability to parameter 
errors. The rate limit should always be used during the start of the recursive 

identification, and a small value of W ^0 can be used to avoid the possibility of 
control divergence, should the estimated T-matrix be too small. The control magni- 
tude constraint Wq may not be too useful, since it limits the control relative to 
the ideal value 0 q rather than relative to an absolute value. Absolute limits on 
the control magnitude are probably better applied by uniformly reducing the elements 
of 0 before the command signals are sent to the actuators. The benefits of the 
cautious controller can probably be obtained more directly by the appropriate choices 
of W 0 and Wy ^0 (which could be temporarily increased in special circumstances such as 
the start of the identification algorithm). The use of a dual controller does not 
appear necessary, since the identif iability problems encountered are not accompanied 
by poor controller performance. 

Regarding the regulator algorithms, it is concluded that the following options 
(in order of preference based on simplicity) are potentially applicable to the control 
of helicopter vibration. 
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1. Invariable open-loop regulator: This is the simplest option. It has no 

stability problems. This regulator will be satisfactory only if there are no signif- 
icant parameter errors. 

2. Invariable closed-loop regulator: This option provides good performance if 

the measurement noise is not too large. It will be satisfactory if the parameters do 
not vary so much that the system becomes unstable. 

3. Adaptive open-loop regulator, with only the uncontrolled vibration level 

identified: This is the simplest adaptive option. It has no identif lability prob- 

lems, and may provide good performance and stability. This regulator will be satis- 
factory if it can provide good control, particularly with time-varying parameters. 

4. Adaptive open-loop or closed-loop regulator, with all parameters identified: 
This option probably has the best performance with time-varying parameters. The open- 
loop and closed-loop cases are nearly indistinguishable in terms of system perfor- 
mance. This regulator will be satisfactory if the identif lability problems do not 
degrade the performance, and if the helicopter response is not too nonlinear. 

5. Adaptive closed-loop regulator, with the local helicopter model: This option 

is probably most suitable for very nonlinear systems; however, there are identif labil- 
ity problems. 

The theoretical and experimental work to date concerning these regulators sug- 
gests that an adaptive system will be needed. Hence, it is anticipated that one of 
the last three options will be required for helicopter vibration control. 


RECOMMENDATIONS 


Further work on self-tuning regulators for the multicyclic control of helicopter 
vibration is required in the following topics. 

1. The conclusions of the present report must be verified or modified for the 
multivariable case. The implications of the use of cosine and sine components in the 
input and measurements must be investigated. 

2. Techniques for the numerical implementation of the identification and control 
algorithms must be developed. 

3. The regulator development can be extended; for example, dynamics can be 
included in the helicopter model, and dual controllers could be considered further. 

4. The regulator designs must be examined more thoroughly in terms of the spe- 
cific characteristics of the helicopter, including the selection of the control and 
measurement variables; off-design performance or the performance with time-varying 
parameters; the influence of noise and nonlinearities; and the influence of the 
regulator on the helicopter trim and on the stability augmentation system. 
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Finally, the regulators require further experimental development and experimen- 
tal confirmation of their performance in order to complete the development. 


Ames Research Center 

National Aeronautics and Space Administration 

Moffett Field, California 94035, September 21, 1981 
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